SOFIC MEASURE ENTROPY VIA FINITE PARTITIONS 



DAVID KERR 

Abstract. We give a generator-free formulation of sofic measure entropy using finite partitions 
and establish a Kolmogorov- Sinai theorem. We also show how to compute the values for general 
Bernoulli actions in a concise way using the arguments of Bowen in the finite base case. 



1. Introduction 

Kolmogorov introduced the notion of entropy for a measure-preserving transformation of a 
probability space by first defining it locally on partitions as a limit of averages of the Shannon 
entropy under iteration and then showing that all generating partitions with finite Shannon 
entropy yield the same value. To handle the case in which there is no such generating partition, 
Sinai proposed taking the supremum over all finite partitions, thereby furnishing what is now 
the standard definition. The Kolmogorov- Sinai theorem asserts that this supremum coincides 
with Kolmogorov's entropy in the presence of a generator. Ultimately it was realized that this 
set-up works most generally for measure-preserving actions of amenable groups, and in the case 
of a countably infinite amenable group Ornstein and Weiss showed that entropy is a complete 
invariant for Bernoulli actions [6j. 

Recently Lewis Bowen greatly extended the scope of this classical theory to measure-preserving 
actions of countable sofic groups by replacing the internal information-theoretic approach of Kol- 
mogorov with the statistical-mechanical idea of counting external finite models [U [3] . Bowen 
first defined the dynamical entropy of a finite partition by measuring the exponential growth of 
the number of models with respect to a fixed sofic approximation sequence for the group, and 
then he showed that any two generating finite partitions produce the same value. By a limiting 
process he also extended this analysis to partitions with finite Shannon entropy. Bowen was 
thereby able to extend the Ornstein- Weiss entropy classification of Bernoulli actions to a wide 
class of nonamenable acting groups, including all nontorsion countably infinite sofic groups. 

For various reasons, including the possibility of formulating a variational principle, one would 
like to remove the generator assumption in Bowen's definition. Sinai's solution of taking a 
supremum over finite partitions does not work in this case, as illustrated by the fact that any 
two nontrivial Bernoulli actions of a countable group containing the free group F2 factor onto 
one another [2]. To circumvent this problem, Hanfeng Li and the author developed an operator 
algebra approach using approximate homomorphisms that allows one to broaden the meaning 
of generator to bounded sequences of functions in L°°. This leads to a completely general 
notion of sofic measure entropy, as well as a topological counterpart and a variational principle 
relating the two [4j. As in Bowen's setting, when the acting group is amenable one recovers the 
Kolmogorov-Sinai entropy [5]. 
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The question still remained, however, whether there exists a generator-free definition that 
uses only finite partitions, in the spirit of Sinai. The aim of this note is to provide such a 
definition and to establish a Kolmogorov-Sinai theorem for it, which we do in Section [2l We 
continue to use the homomorphism perspective of ^j, although we avoid linearizing and work 
only with algebras of sets. The novelty here is to define the entropy locally with respect to two 
partitions playing different roles. The sofic modeling of the dynamics is expressed with respect 
to one partition, as in Lewis Bowen's original approach, while the second partition is used to 
express the observational scale at which we are able to distinguish different models, in analogy 
with Rufus Bowen's (n, e)-separated set definition of topological entropy for homeomorphisms. 
We take an infimum over all partitions playing the first role while holding the second one 
fixed, and then take a supremum over all partitions playing the second role. We then prove a 
Kolmogorov-Sinai theorem (Theorem 12. 6p which says that to compute the entropy it suffices that 
all of these partitions range within a given generating u-algebra. This provides for a relatively 
concise computation of the entropy of general Bernoulli actions of sofic groups which builds on 
arguments from [IJ. We provide complete details of this computation in Section [H In Section [3] 
we show that our definition of sofic measure entropy is equivalent to the one from |3] and hence 
also, in the presence of a generating partition with finite Shannon entropy, to Lewis Bowen's 
definition. 

Acknowledgements. This work was partially supported by NSF grant DMS-0900938. I thank 
Lewis Bowen and Hanfeng Li for corrections. 

2. Definitions and a Kolmogorov-Sinai theorem 

Let G be a countable sofic group. Soficity means that there are a sequence {di}^^ of positive 
integers and a sequence {ai : G Sym((ij)}^^ which is asymptotically multiplicative and free 
in the sense that 

lim —\{ke{l,...,di}: ai^st{k) = cri^s'yi^t{k)}\ = 1 
j— i>oo di 

for all s,t £ G and 

lim —\{k e {I,. . . ,di} : ai^s{k) / cri,t{k)}\ = 1 

for all distinct s,t £ G. Throughout the paper S = {a^ : G — )• Sym{di)}°2^-^ will be a fixed but 
arbitrary such sofic approximation sequence. 

Let (X, 'B,/i) be a probability space and G r\ X a measure-preserving action, which we fix 
for the purposes of this section and the next. 

Write 7^ for the power set of {1, . . . , d}, which we view as a fi-algebra. The uniform probability 
measure on {1, . . . ,d} will always be written For a family 3" of subsets of a set X we write 
for the a-algebra generated by 3". For a measurable partition a and a finite set F C G we 
write ap for the partition {Hsgf '■ A G q^} where Ag denotes the value of A at s. 

We write N^{-, p) for the maximal cardinality of an (e, p)-separated subset, i.e., a subset which 
is e-separated with respect to p. 

Definition 2.1. Let a be a finite measurable partition of X, F a finite subset of G, and 5 > 0. 

Let o" be a map from G to Sym((i) for some d E N. Define Hom^(a, F, 5, cr) to be the set of all 
homomorphisms (f : S(ai?) — > such that 

(i) EAea Ws'p{A)Aip{sA)\/d < 6 for ah s e F, and 
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(ii) EA^a,\C{^iA))-KA)\<6. 

For a partition ^ < a, write |Hom^(a, -F, 5, cj)|^ for the cardinality of the set of restric- 
tions of elements of Ilom^{a, F, S, a) to ^. Using sums in (i) and (ii) of Definition 12.11 ensures 
the convenient monotonicity property that Hom^(a, 5, a) 2 ilom^{a' , F' , 5' , a) and hence 
\Rom^{a,F,6,a)\^ > \Romf,{a' , F' , 6' , a)^ whenever a<a', F OF', 6> 6', and ^ > 

Definition 2.2. Let S be a a-subalgebra of 23. Let ^ and a be finite measurable partitions of 
X with a > ^. Let F be a nonempty finite subset of G and 6 > 0. We define 

/i|_^(a,F, 5) = limsup-^log|Hom^(a,F, (5, cri)|g, 

4,m(«) = ™f4,/.(«'^)' 
4,/.(s) = inf4,/.(«)' 

^s,/.(S) = sup/i| (S) 

where the infimum in the third line is over all nonempty finite subsets of G, the infimum in the 
fourth line is over all finite partitions a C S which refine ^, and the supremum in the last line 
is over all finite partitions in S. If Hom^ (a, 5, crj) is empty for all sufficiently large i, we set 
h^^{a,F,S) = — oo. 

Definition 2.3. The measure entropy h-E^{X,G) of the action with respect to E is defined as 

We now aim to establish in Theorem 12.61 the analogue of the Kolmogorov-Sinai theorem in 
our context. 

Lemma 2.4. Let a be a finite measurable partition of X and let e > 0. Then there is a 
^ > such that for every a-subalgebra § of "B with maxyig^ inf^gg /^(^^-B) < 6 there exists a 
homomorphism : — t- S satisfying fj,{9(A)AA) < e for all A € 

Proof. Let 6 > 0, and let S be a cr-subalgebra of 23 such that max^igQ, inf^gg fi(AAB) < 5. Let 
Ai, . . . , An be an enumeration of the elements of a. For i = 1, . . . , n—1 we recursively define 9{Ai) 
to be an element of S contained in the complement of 0{Ai) U • • • U 9(Ai-i) so that the quantity 
IJ,{9{Ai)AAi) is minimized. Then define 9{An) to be the complement of 9{Ai) U • • • U 9{An-i), 
which gives us a homomorphism 9 : S(q!) —^§. It is then readily seen that if 5 is small enough 
as a function of e and \a\ we will have fi{9{A)AA) < e for all A £ □ 

Define on the set of all homomorphisms from some a-subalgebra of "B containing ^ to the 
pseudometric 

p^{ip,i;) = maxhip{A)Ai,{A)\. 
Ae^ a 

For e > set 

/i|^^(a,F,5) = limsup-i-logiV£(Hom^(a,F,(5,cri),/9^), 
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where the last infimum is over the nonempty finite subsets of G. 

Lemma 2.5. Let j be a finite measurable partition and let k > 0. Then there is an e > such 
that hj. ^{(3) < h'^^^{l3) + k for all finite measurable partitions /3 refining 7. 

Proof. This follows from the fact that, given e > 0, A C {1, . . . and ti G N, the set of 
all B C {!,..., d} such that C,{B/S.A) < e has cardinality at most {^^^^), which by Stirling's 

approximation is less than e'^'^ for some k > depending on e but not on d with k ^ as 
s^O. □ 

Theorem 2.6. Let § be a generating a-subalgebra ofB. Then hY,^f^{X,G) = /ie,^(S)- 

Proof By symmetry it suffices to show that if T is another generating fi-subalgebra of S then 

Let 7 be a finite partition in T. By Lemma [2 . 5 1 there is a e > such that /i^ < + ^ 

for all finite partitions /3 Q7 which refine 7. 

Since S is generating there are a finite partition ^ C S and a nonempty finite set K G 
such that for every € 7 there is a C for which the set B' = UyeA^ ClseK satisfies 
H{BAB') < e/16. 

Take a finite partition a C S with a > ^, a finite set F Q G containing K U {e}, and a 6 > 
such that ^ 

limsup — log |Hom„(a, F, 6, crjllf < /il (S) + k. 

By shrinking 6 if necessary we may assume that it is less than e/(8|^''^ I l-^^D- Since 7 is generating, 
there are a finite partition /3 C T refining 7 and a nonempty finite set E C G such that 
for every A G S(ai?) there is a C for which the set A' = UygA^ flsgB satisfies 
H{AAA') < V(12|a^|). 

Take a 5' > which is smaller than 5/(9|a^||/3^||£'|) and also small enough so that every 
if E }iom^{f3,FE,5',a) satisfies C{^{B)) < 2^i{B) for all B G T,{/3fe)- 

By Lemma 12.41 there is a homomorphism 6 : T,(aF) Ti{f3pE) such that fj,{9{A)AA) is less 
than both 6/{12\a^\) and e/(16|^^|) for all A G Eiap). 

Let o" be a map from G to Sym(d) for some d G N which we assume to be a good enough sofic 
approximation to obtain an estimate below. Let 93 G Hom^(/3, 5', cr). Set (p^ = ipo0. We 
will show that ip^ G Hom^(a, F, (5, a). 

Let t £ F. Then for every ^ G a we have, assuming that ex is a good enough sofic approxi- 
mation, 

^\ip{tA')Ac7MA')\ < J]i|v5(tsn)Aat^(sn)! 

+ \at{asipiYs)Aip{sYs)\) 
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<3|/3^||£;|y < 



3|a| 

and iJ,{e{tA)AtA') < ij,{e{tA)AtA) + ij,{AAA') < d/{6\a\), whence 

^ h^\tA)Aat^\A)\ < ^ ^{\ip{eitA)AtA'))\ + \^itA')AaMA')\ 



+ \aMA'Ae{A))\) 



< 2\a\fi{9{tA)AtA') + - + 2\a\n{A' Ae{A}) < S. 

3 

Also, for every A G air we have \C{v{A')) - fi{A')\ < S' < 6/{3\a^\) and fx{e{A)AA') < 
fi{9{A)AA) + fi{AAA') < 6/6\a^\ and so 

^ |C(¥.H^))-M^)I< E (IC(^W^)A^O)l + IC(v^(^'))-M^')l 

+ HA'AA)\) 



< E (2i,{9{A)AA') + 2 . < S. 



Thus G Hom^(Q!, F, 6, a). 

Let r : Hom^(/3, FE', (5', cr) ^ Hom^(a, F, (5, a) be the map i-)- Take an e' > such that 
s' < e/(8|^^||i^|). Let ip and ip be elements of Hom^(/3,F£;,(5',(7) with p^{ip\ip^) < 2e' . For 
every 5 G 7 we have 

FeAs sex 
< |e''|ii^|(5 + 2£' + 5) < ^ 



2 



and 



li{BAQ{B')) < n{BAB') + fi{B'Ae{B')) 



yeA 



and hence 



p^((^,V) =max^|^(5)AV'(S)| 

< maxl{\<f{BAe{B'))\ + |^^(5')AV;Vs')| + |V'(^(S')A5)|) 

BG7 tt 
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< 4maxn{BAe{B')) + J < e. 

-BG7 2 

It follows that for every {e, p^)-separated set Q C Hom^(/3, FE, 5' , a) the image T{Q) is (e', p^)- 
separated, and so 

Ne{Rom^{l3,FE,6',a),p^) < Ne'{}iom^{a, F,d,a), p^) < \Rom^{a, F, 6, a)\^. 
Consequently, 

< < hi:^m + ^ 

< limsup ^logNs(Homn{(3,FE, 6' ,ai),p^) + k 

< limsup — log |Hom^(a, F, 6, + k 

Since 7 was an arbitrary finite partition in 7 and k an arbitrary positive number, we conclude 
that h^^^{7) < /is,^(S)i as desired. □ 

3. Comparison with prior definitions 

In this section we continue the notational conventions of the previous section, with the addi- 
tional assumption that the probability space X is standard. Our aim is to prove that h-£^^{X, G) 
agrees with the entropy defined in Section 2 of [5]. By Section 3 of [5], this will also show that 
hT,,^{X,G) agrees with Bowen's entropy in the presence of a generating partition with finite 
Shannon entropy. 

Write H'y; ^{X, G) for the sofic measure entropy as defined in Section 2 of [4j. We will use the 
following equivalent formulation of h'j.^(X,G) in terms of topological models (see Section 3 of 
[5j). Suppose that X is a compact metrizable space, the action of G on X is by homeomorphisms, 
and /9 is a compatible metric on X. For a given d € N, we define on the set of all maps from 
{1, . . . , d} to X the pseudometrics 



1 



d s 1/2 



^ k=l 

Poo{v,i^) = , max p{ip{k),'ip{k)). 

k=l,...,d 

Let F be a nonempty finite subset of G, L a finite subset of C{X), and 5 > 0. Let o" be a 
map from G to Sym(d) for some d £ N. We write Map^{p, F, L,5,a) for the set of all maps 
if : {1, . . . ,d} —^X such that, writing l for the action of G on X, 

(i) p2{f o CTs, i^s ° f) < S for all s € F, and 

(ii) |((^,C)(/)-M/)| <'^for all/GL. 

For e > we define 

hh,f,{p, F, L, 6) = limsup log iVe(Map^(p, F, L,6,ai), poo), 

hhAp) = '^)' 
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e>0 

where in the second hne L ranges over the finite subsets of C (X) and F ranges over the nonempty 
finite subsets of G. By Proposition 3.4 of [5] we have /i^ ^{^^ G) = /is.^ilp)) a fact which will be 
used tacitly in the proof below. 

Theorem 3.1. h^^^,{X,G) = h'^ ^{X,G). 

Proof. We begin by showing that hY,,^{X,G) < h'^^ ^[X^G). Suppose first that we are in the 
case hj]^fj^{X, G) < oo. Then given a k > we can find a finite measurable partition ^ of X such 
that h^^f^{X,G) < hj. ^CB) + k. By replacing X with the spectrum of some separable unital 
G-invariant C*-subalgebra of L°°{X,iJ,) containing the characteristic functions of the atoms of 
^, we may assume that X is a compact metrizable space with compatible metric p, the action 
of G is by homeomorphisms, and ^ is a clopen partition of X. 

Let e > be smaller than the minimum of the Hausdorff distances between B and B' over all 
distinct B, B' € ^. Let F be a finite symmetric subset of G containing e and L a finite subset 
of C{X). Let (5 > 0, to be further specified. Let S' > 0, to be further specified as a function of 
6, n, {apl, and L. Let a : G — )• Sym{d) be a good enough sofic approximation for a purpose to 
be described shortly. 

Let a = {Ai, . . . , A^} be a finite measurable partition of X refining ^ such that each Ai has 
diameter less than 6. Given a if £ Hom^(a, F, 6' ,a), we construct a map : {1, . . . , d} — )■ X by 
considering for each k € {1, . . . ,d} the element / S {!,..., n}^ such that k € (/'(flteF *^/(*)) 
and defining (p{k) to be any point in f^^^ptAj^^^^y Given an s £ F, set 



Cs = [J{a;'^{A,)nip{s-'A,)). 



i=l 



Assuming cr is a good enough sofic approximation so that the restrictions of a^^ and cr^-i agree 
on a subset of proportional size sufficiently close to one, we will have \Gs\/d > 1 — 2n6' . Now 
for k £ Gs and i = 1, . . . , n we have, writing Tg^j for the set of all / G {1, . . . , n}^ such that 
/(e) = Ai and T^-i j for the set of all / G {1, . . . , n}^ such that f{s~^) = Ai, 

0{as{k))eAi= 11 ntAfU)^as{k) e 11 f(ntAfU))=^{Ai) 



u n^M) 


<^ 




Jf]tAf 


fer,,, teF 












k e cT7V(^i) 








k € (p{s^^Ai) 


= U ■ 














m e u 


n *^/(*) 














sip{k) £ Ai. 





^t€F 

s-^Ai 



Since the diameter of Ai is less than 5' this shows that p{tp{a s{k)) , s(p{k)) < 6' and hence, if 6' 
is small enough as a function of 6 and n, that p2{(p o o's, ts ° 0) < ^ for all s G F where l denotes 
the action of G on X. Also, for A G ap we have = C{^~^{A)) = ({ip{A)), and thus, for 
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/ G L if we find scalars Cf^A such that ||/ — ^A&ap '^/,-4-'--4lloo < (^/3 and take 6' small enough so 
that EAea^ |c/,a||C(¥'(^)) - m(^)I < S/S we will have 



l(<^*C)(/)-M/)l< 



+ 



Consequently G Map^(p, F, L, (5, cr). Moreover, if (p and are elements of Hom^(Q;, F, (5', cr) 
whose restrictions to ^ differ, then Poo{0, '0) > by our choice of e, and so |Hom^(a, F, S', a)\^ < 
Ns{Map^{p,F,L,S,a),poo)- Hence h^^^{a,F,S') < h^^^{p,F,L,S) and so 

h^,^{X,G) -K< hij'B) < hh,^{p) < hj,M = /i's,^(X,G). 

Since k was an arbitrary positive number we thus obtain hY:,fj,{X, G) < h'j^ f^{X, G). In the case 
^s,^(^j G) = oo we can argue in the same way only starting with the fact that for every M > 
there is a finite measurable partition ^ of X satisfying ^(55) > M. 

We now establish the reverse inequality. By replacing X with the spectrum of the unital G- 
invariant C*-subalgebra of L°°(X, p) generated by the characteristic functions of some countable 
generating collection of measurable sets, we may assume that X is a zero-dimensional compact 
metrizable space with compatible metric p and that the action of G is by homeomorphisms. Sup- 
pose that we are in the case /is,^j(/o) < oo. Then given a k > there exists an s: > such that 
h's,fj,{p) < ^{p) + K. Pick a finite measurable partition ^ of X such (hat the diameter of each 
of its atoms is less than e. Take a finite measurable partition a = {Ai, . . . , A^} of X refining ^, 



a finite symmetric subset F of G containing e, and a 5 > such that hj. ^{a, F, 6) < hj. ^{"B) + 
Now it is readily seen that if a' = {A[, . . . , A'^} is an ordered measurable partition of X refin- 
ing ^ such that maxj=i^...^„ p{AiAA'-) is sufficiently small then, for each sufficiently good sofic 
approximation a : G ^ Sym(d), composing an clement of iiom^(a' , F, 6 /2, a) with the homo- 
morphism 9 : T,{aF) '^{(^f) defined by 9{f\^^ptAf(j.-^) = Q^^p for all /€{!,... ,n}^ 
yields an element of Hom^(a, F, 5, a), in which case |Hom^(a', F,S/2, a)\^ < |Hom^(a, F, S, cj)|j. 
By a standard approximation argument one can find such an a' consisting of clopen sets, and 
so we may assume that a itself is a clopen partition of X. 

Let 6' be a positive number to be determined which is smaller than the Hausdorff dis- 
tance between Ai and Aj for all distinct i,j = l,...,n. Write L for the set of character- 
istic functions of the atoms of ap. Let a be a map from G to Sym((i) for some d G N. 
Given a (/? G Map„(p, L, (|F|n)~"^5, a), we construct a homomorphism if : S(a_p) — t- CP, 



K. 



d 



by declaring (^(Q^g^ t^j^^)) for a / G {l,...,n}^ to be the set of all k G such 
that (p{k) G Pljgp, tylj(j). For s e F write Dg for the set of all k G {!,..., d} such that 
p(ip(a^^(k)).s^^ip{k)) < 6'. Assuming cr is a good enough sofic approximation so that the re- 
strictions of a^^ and (Jg-i agree on a subset of proportional size sufficiently close to one, and 
that 6' is sufficiently small as a function of {\F\n)~^5, we have \Ds\/d > l — S/n. Also, for fc G -Ds 
and i = 1, . . . , n we have, writing Te,i for the set of all / G {1, . . . , n}^ such that /(e) = Ai and 
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Tg^i for the set of ah / G {1, . . . , n}^ such that f{s) = Ai, 

k € asifiAi) ^ a-\k) G ^{Ai) = t^f{t)) 

/ex,,, ^teF ^ 

^ip{a-Hk))e U f]tAf^t)=Ai 

4^ (p{k) € sAi = U ^^/(i) choice of 5') 

Consequently ^"^^^ |fTs(^(^j)A(^(s^i)[ < 6 for all s G F assuming 5' is small enough. Since 
CmA)) = {ip.OilA) for every ^ G a^. so that Eag^^ ICl'^C^)) - ^(^)l < |aF|(|F|n)-i5 < ,5, 
it follows that (p G Hom^(a, F, 5, u). 

Now since the atoms of ^ all have diameter less than e, we have (p\^ ^ Vl^ fo^' ^'h (p^tp ^ 
Map^^p, F, L, 5, a) satisfying poo{(p,i^) > e. Therefore 

iV,(Map^(p,F,L,(|F|n)-i(5,a),/)oo) < |Hom^(a, F, 5, 

and hence /i^ ^(/c, F, L, (|F|n)^-'^(5) < /i| ^(a, F, (5). We thus deduce that 

Since was an arbitrary positive number we conclude that G) < hs^^iX^G). In the 

case hY.,fi{p) = oo we can apply the same argument only starting from the fact that for every 
M > there is an e > for which /if. ^{p) > M. □ 

4. Bernoulli actions 

Here we show how to compute the sofic entropy of Bernoulli actions according to Definition l2.2[ 
This only depends on the asymptotic freeness of the sofic approximation sequence, in contrast 
to Definition 12.21 and Theorem 12.61 which do not depend on it at all. The following lemma will 
permit us to reduce the computation to Bowen's arguments in the finite base case p]. As in 
the previous sections, S = {fij : G Sym{di)}'^^ is an arbitrary fixed sofic approximation 
sequence. 

Lemma 4.1. Let {X,p) be a probability space and G r\ X a measure-preserving action. Let ^ 
and a be finite measurable partitions of X with a > S,. Then 

(i) hija) < H^iO, 

(ii) hija)>h%Ja)-H,{a\0. 

Proof. First we prove (i). Write ^ = {Bi, . . . ,Bn}. Let e > 0. By the continuity properties of 
H{-), there is a (5 > such that, for all d G N, if 7 = {Ci, . . . , C„,} is an ordered partition of 
{!,..., 4 with Er=i|M^O-C(a) I < ,5 then \H^{C) - H^{^)\ < e. 

Fix a (i G N. Write T for the set of tuples (ci, . . . , c„) G {l/d, 2/d . . . , 1}" such that Y17=i '^i ~ 
1 and \p{Bi) — Ci\ < 5. For each c = (ci, . . . ,Cn) G T write Wc for the set of all ordered 
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partitions 7 = {Ci, . . . , C„} of {1, . . . , d} such that \Ci\/d = Ci for every i = 1, . . . , n. By our 
choice of 5 and Stirhng's approximation, we have, assuming d is sufficiently large, 

"'^'="-M)!...(c„d)!-if^ 

for every c (zT. Note also that \T\ < {25d)'^ since there are at most 25d choices for the value of 
each Ci among the elements of T. The total number of homomorphisms (/? : S(^) — )• [P^ satisfying 
Yll=i lC(¥'(-Si) — ^J'{Bi)\ < 5 is equal to | Ucgt and from what we have just observed this is 
bounded above by (2(5d)"e'^(^+^)(^''(«)+^). Hence 

4,^(«) < hi^^{a,{e},5) < hl^{^,{e},6) < (1 + e){H,{0 + e). 

Since e was an arbitrary positive number we obtain (i). 

Now let us prove (ii). Let e > 0. Write ^ = {Bi, . . . , Bm}- For each i = l,...,m write 
Oj = • • • jAi^m} for the partition of Bi consisting of those members of a contained in Bi. 

By the continuity properties of H{-) there is a 5 > such that, for all d € N, li ip : S(a) — )■ Td 
is a homomorphism satisfying YIai^o |C(V'(^)) ~ /^(^)| < ^ then \H^^{ai) — H(^^{-ip{ai))\ < e for 
every i = 1, . . . ,m, where fii is fi{Bi)~^ times the restriction of fi to Bi and Q is C{ip{Bi))^^ 
times the restriction of ( to ip{Bi). 

Suppose we are given a homomorphism -0 : S(a) — > satisfying "^^Aea \ C{4'{A)) — fi{A)\ < 6. 
Write Qi for the set of all ordered partitions {Ci, . . . , C„. } of il^{Bi) satisfying X]j=i ~ 
C(Cj)| < 5. Then the set of all homomorphisms if : S(a) — > I'd which satisfy Yl^i {CifiBi)) — 
l^{Bi)\ < 5 and restrict to ^ on ^ has cardinality at most YliLi \Qi\- By an estimate as in the 
second paragraph using Stirling's approximation, assuming d is large enough the set Qi has 
cardinality at most (2(5d)"'ef('^(^'))(^+^)(^'^» ("')+^), and since 



J2mB^))H,M) <Y,t^{Bi)H^^{ai) + 5 = H,{a\0 



this gives 



i=l 

It follows that for every nonempty finite set F C G we have 

hija,F,6) > h%Ja,F,6) - {1 + e){H^{a\0 + 6 + e) 

and hence ^(a, F) > /i^ ^(a) — (1 + e)(-?/^(a|^) +e) as 5 can be taken arbitrarily small. Since 
£ was an arbitrary positive number, this yields (ii). □ 

For a probability space {Y,iy) we define -ff(z^) to be the supremum of H^{a) over all finite 
measurable partitions a of y. 

Theorem 4.2. Let {Y, u) be a probability space and let G r\- {Y^, v^) be the associated Bernoulli 
action. Then h-^^yciY'^ ,G) = H{v). 

Proof. Let S be the u-algebra consisting of those measurable subsets of Y^ which are cylinder 
sets over e. Then § is generating and so it suffices by Theorem 12. 6l to show that = H{v). 

By Lemma l4.1( i) we have ^ Biy), and so we concentrate on the reverse inequality. 
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Let ^ and a be finite partitions in S witfi a > ^. We will show that hj, ^{a) > -ff^(^), from 
which the desired inequality /is,^(S) > H^iy) ensues. By Lemma HTTT ii) we need only prove that 
— This is essentially contained in Theorem 8.1 in [1], and we will reproduce the 

argument from there. 

Let (5 > 0. Let t] > he such that 2ri < \a\^^-^^6. Let F be a finite subset of G containing e. 
Let d € N and let cr be a map from G to Sym{d) which is a sufficiently good sofic approximation 
to satisfy a couple of conditions to be specified below. Write V for the set of all f G {1, . . . , d} 
such that ascrt{v) = (Tst{v) for all s,t G F and aj^{v) 7^ a^^{v) for all distinct s,t G F. 

Enumerate the elements of a as ^1, ... , A„. Write k for the probability measure on {1, . . . , n} 
determined by K{{i}) = fj.{Ai). We view {1,... ,n}'^ as a probability space with the product 
measure k'^. 

Fix an / € {l,...,n}^. Given a 7 € {l,...,n}'^ we can think of it as an ordered par- 
tition {7~-'^(l), . . . , 7^-'^(n)} of {1, . . . ,d}, and in accord with this viewpoint we set Q^yj = 
Cls&F ^s"f~^{f{s))- Write Pf for f]^^^ sAj(^sy For every 7 G {1, . . . ,n}'^ denote by tpj the ho- 
momorphism S(a_p) — )• I'd determined by <p.y{Pf) = Q-yj- Note that for s ^ F and i = 1, . . . ,n 
we have, writing T^.i for the set of / G {1, . . . , n}^ such that /(s) = i, 

sAi = sAinX = sAin( f] LJ = U ^/ 

and similarly as^~^{i) = U/eTs , ^'^ t^iok, 

\iPy{sA.-;)Aa,^y{Ai)\ < \asi7'\i)Aae7'\i))\ < \{v e {1, . . . ,d} : aeiv) ^ v}\ < 6d 

assuming cr is a good enough sofic appproximation. Thus we get that condition (i) in the 
definition of Iiom^(a, F, 6, a) is satisfied by (p^ for all 7. We now aim to get a lower bound on 
the number of 7 for which ip^ satisfies condition (ii) in the same definition and hence lies in 
Hom^(a, F, 5, a). 

For V € {1, . . . ,d} we let = Z^j be the function (random variable) on {1, . . . , n}'^ which 
at a point 7 takes the value 1 ii v £ V H Q^j and otherwise. 

Write E(-) for the expected value of a function on {1, . . . , n}'^, that is, the integral with respect 
to k'^. For V ^ V we have E(Z^) = 0. For v ^V, since aj^{v) / ag^{v) for distinct s,t £ V we 
have 

E{Z,) = k'^({7 e {!,..., nY: a-\v) G 7"'(/(s)) for every s G F}) 

= n ^({/(^)}) = n = ^""(^z)- 

Set Z = Ylt=i -^f • ^il^ estimate the variance Var(Z). Let v, w G {1, . . . , d}. If one of v and 
w is not in V then Z^Z^ = and so K{ZyZ^) = 0. If crs{v) 7^ crt{w) for all s, t G F then Zy and 
Zy, are independent, i.e., K{ZyZw) = E(Z^)E(Z^). Thus the number of pairs {v,w) E V x V 
for which Zy and Z^ are not independent is at most which is bounded above by 

Hence 

d d 

E{Z^)= HZvZy,)< ^ EiZy)E{Zy,) + d\F\'^ =E{Zf + d\F\\ 

v,w=l v,w=l 
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and so Var(Z) = E{Z'^) - E{Zf < Chebyshev's inequality then yields, for all t > 0, 

mz/d-Eiz)/d\>t)<'^<\^. 

Assuming that cr is a good enough sofic approximation so that C(^) > 1 for every 7 we have 

\aQ,,f) - ^''iPf)\ < |C(Q7,/) - n Q,j)\ + \{z/d)ij) - E{z)/d\ 

+ |C(y)^«(P/)-^«(P/)| 

<\{Z/d)i^)-E{Z)/d\+2n 

and thus, for t > 2r], 

F(K(9„;)-.«WI>t)<;J^. 

Taking t = n~\^^S, which is larger than 2ri, we get, assuming d is large enough, 

S \ S 



i^(|C(Q.,/)--^(^'/)|>^)< 



Thus the probability that a 7 G {l,...,n}'^ satisfies |C(Q7,/) ~ '^'^iPf)\ > n~^^^S for some 
/ G {!,..., n}^ is at most 6. If this does not happen for a given 7 then 

/e{l,...,n}f' /G{l,...,nK 

Hence the probability that 7 satisfies (/?^ G Hom^(a, F, 5, o") is at least 1 — 5. Now we need to 
use this to estimate the actual number of 7 satisfying (p^ G Hom^(a, F, 5, a). 

With 7 ranging as usual in the probability space {!,... ,n}'^ we have, by the law of large 
numbers and the independence of the coordinates of 7, 

^ \ogK'^i-f)-H{K) >S) =0. 



lim „ . 

Thus, assuming d is sufficiently large we can find an L C {!,..., n}*^ for which n'^[L) > 1 — 5 
and ^'^({7}) < e~'^(^('*)~'^) for all 7 G L. Then, writing Lq for the set of all 7 G L such that 
(^-y G Homju(Q;, F, 5, cr) we have k'^(Lo) > 1 — 2(5 and hence 

|Hom^(a,F,(5,(7)|a > |Lo| > K'^(Lo)e'^(-^('^)-'^) > (1 - 2(5)e'^(-^W-'^). 

Since 5 can be taken arbitrarily small, it follows that h'^^aip-^F) > H{k) = Hn{a). Since F 
was arbitrary finite subset of G containing e, we conclude that i^g{(x) > Hn{a). □ 
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